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Objective: We aimed to summarize the evidence from randomized clinical trials studies examining 
the efficacy of ischemic postconditioning (IPost) in ST-elevation myocardial infarction. 
Design: The study was a systematic review and critical appraisal, with meta-analysis of ran- 
domized clinical trials. 

Materials and methods: We searched the literature. A total of 21 randomized clinical trials 
were identified. Both fixed effect and random effects models were used to synthesize the results 
of individual studies. Heterogeneity between studies was examined by subgroup and random 
effects meta-regression analyses, considering ptient-related and study-level variables. Publica- 
tion bias, or "small-study effect", was evaluated. 

Results: Substantial heterogeneity was present. The random effects model pooled estimate for 
the outcome infarct size assessed by cardiac magnetic resonance was estimated by the stan- 
dardized mean difference (SMD) =-0.06, 95% confidence interval (CI): -0.34 to 0.21, ie, no 
effect of IPost. For the end point infarct size, estimated by biomarkers of myocardial necrosis, 
an overall pooled effect was SMD =-0.58, 95% CI: -0.96 to -0.19. This effect disappeared in 
powered and nonbiased studies (SMD =0.03, 95% CI: -0.48 to 0.55). Finally, for the outcome 
left ventricular ejection fraction, SMD =0.47 95% CI: 0.20 to 0.74. Unfortunately, selection bias 
(small-study effect) was present. For this outcome, the meta-regression showed that both presence 
of hypertension and the inclusion of nonbiased studies explained 28.3% of the heterogeneity 
among the studies. Simulation by the "trim and fill" method, which controlled for selection bias 
using random effects model, diluted the effect (SMD =0.17 95% CI: -0.13 to 0.48). No effects 
by IPost on ST-segment resolution or on the majority of adverse clinical events were observed 
during follow up, except the incidence of congestive heart failure was found. 
Conclusion: Evidence from this study suggests no cardioprotection from IPost, on surrogate 
and the majority of clinical end points. A possible beneficial effect on the incidence of congestive 
heart failure needs to be replicated by a large clinical trial. 

Keywords: ischemic postconditioning, acute myocardial infarction, percutaneous coronary 
intervention 

Introduction 

Rapid, complete, and sustained reperfusion of the infarct-related coronary artery is 
a cornerstone in the treatment of acute ST-elevation myocardial infarction (STEM!). 
Primary percutaneous coronary intervention (PCI) is the preferred method of 
reperfusion if this can be performed within recommended time frames.' However, in 
spite of revascularization and adjunctive medical treatment, mortality and morbidity 
after STEMI are still high.^ Paradoxically, reperfusion itself can enlarge the infarct 
size, by complex mechanisms collectively termed ischemia/reperfusion injury.^ 
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In a previous study, different pharmacological principles that 
aimed to reduce ischemia/reperfusion injury failed to show 
effect.^ In 2003, Zhao and et all published experimental data 
demonstrating a considerable reduction of infarct size by a 
reperfusion procedure termed ischemic postconditioning 
(IPost), consisting of brief, repetitive cycles of reperfusion 
and reocclusion, followed by sustained reperfusion.* An 
infarct-reducing effect of IPost was confirmed in several 
animal models,' and subsequently, in small-sized "proof 
of concept" clinical studies, reduction of infarct size by 
IPost was reported.^"' A previous review and meta-analysis* 
indicated positive effects with IPost and that the outcomes 
of cardioprotection were affected by age, gender, comor- 
bidities, and drugs, as well as by technical issues related 
to the determination of infarct size and revascularization 
procedure. More recently, larger, neutral clinical studies 
on IPost in STEMI have been published.'"'^ Thus, data on 
the effects of IPost in STEMI treated by primary PCI have 
been diverging. We therefore conducted a systematic review 
and a critical appraisal, followed by a meta-analysis, to 
evaluate the effects of IPost on measures of infarct size and 
reperfusion, as well as on adverse clinical events during 
follow up. 



Medline/PubMed (1966-April 8, 2014) 
Embase (1980-April 8, 2014) 
Cochrane library (1966-April 8, 2014) 
Google scholar (1966-April 8, 2014) 



276 references identified 



252 not relevant 



25 potentially eligible studies 



Not appropriate for inclusion: 
2 with no clear randomization procedure 
1 trial with diverging inclusion criteria 
1 trial was a duplicate 



21 studies included in the 
meta-analysis 



Figure I Flow chart of the literature searches for the systematic review of studies 
addressing the efficacy of IPost on infarct size. 
Abbreviation: IPost, ischemic postconditioning. 



Methods 

Literature search 

A qualified medical librarian was consulted at the Medical 
Library, Oslo University Hospital. We searched the Cochrane 
Central Register of controlled trials (1970-2014), Medline/ 
PubMed (1966-2014), and Embase (1980-2014). We used 
a combination of keywords, and details of the search pro- 
cedure are shown in Figure 1 . We used similar strategies to 
identify previously published meta-analyses and reviews. 
In addition, we manually searched conference proceedings 
and textbooks, screened reference lists of all papers, and 
contacted investigators, experts, and a translator. The last 
update for research was done on April 8, 2014. No limitation 
on language was considered. 

Trial selection 

We included randomized clinical trials (RCTs) on patients 
with STEMI and IPost intervention. Two reviewers indepen- 
dently evaluated the reports for eligibility. Disagreements 
were resolved by discussion. We had 21 studies included 
in our meta-analysis.^"'''"^* The study of Roubille et al,^' 
in contrast with other researchers, investigated the effect 
of IPost in STEMI patients with reestablished coronary 
blood flow at admission. The design of their study differs 



fundamentally from that of the other studies of IPost, and 
we therefore did not include it in our review and analysis. 
Similarly, the study of Mewton et aP* was a duplicate of 
the study of Thuny et aP^ and was not considered in our 
review and analysis. 

Quality assessment of the randomized 
trial: the component approach 

Two of the reviewers independently assessed randomization 
and concealment of treatment allocation (selection bias), 
blinding of investigators to outcome (detection bias), drop- 
out rate (attrition bias), and adequacy of analyses according 
to "intention to treat".^' Concealment of allocation was con- 
sidered adequate if the investigators responsible for patient 
selection were unable to suspect, before allocation, which 
treatment was next. Analyses were considered adequate if 
all recruited patients were analyzed in the group to which 
they were originally allocated, regardless of the treatment 
received (intention-to-treat principle). The problem of 
missing patients and dropouts in the analysis was evaluated 
according to Bell et al.'° Also, the beforehand power analysis 
of the trial was considered. This was done as advocated by 
the Cochrane Collaboration's tools for assessing risk of bias 
in randomized trials.^' 
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Data abstraction 

Data regarding publication status, trial design, patient- 
related characteristics, treatment regimens, outcome 
methods, results, and funding were extracted in duplicate 
on a standardized form according to an a priori protocol. 
Investigators were contacted for additional data and cor- 
rections. Disagreements were resolved by discussion with 
a third reviewer and subsequent consensus. Patient-related 
variables were considered in the protocol and included 
mean age; presence of diabetes mellitus, hypertension, and 
dyslipidemia; current smoking habits; presence of anterior 
myocardial infarction; time from start of symptoms to PCI; 
and time to left ventricular ejection fraction (LVEF) evalu- 
ation after PCI. 

End points considered 

The primary end point was the infarct size, as estimated 
from cardiac magnetic resonance imaging (CMR); second- 
ary outcomes were LVEF, as estimated by echocardiog- 
raphy or CMR at different times during follow up, and 
biomarkers of myocardial necrosis. Electrocardiographic 
(ECG) ST-segment resolution was evaluated as a marker 
of reperfusion.^' Adverse cardiac events during follow up 
(mortality, reinfarction, stent occlusion, and development 
of congestive heart failure [CHF]) needed to be analyzed 
using the patient-years model, to control for variability in 
the duration of follow-up of the different trials. 

Quantitative data synthesis 

Statistical pooling 

In order to calculate the "pooled" effect of intervention, 
the total standardized mean difference (SMD), with 95% 
confidence interval (CI), was estimated for fixed and ran- 
dom effects models (Cohen's method). If the value of zero 
is not included in the 95% CI, then the SMD is statisti- 
cally significant at the 5% level (P<0.05). Cohen's rule of 
thumb for interpretation of the SMD statistics is: a value 
of 0.2 indicates a small effect, of 0.5 indicates a medium 
effect, and of 0.8 and over indicates a large effect. As the 
homogeneity hypothesis appeared to be irrelevant, we 
worked with a random effects model. The estimation was 
done according to the DerSimonian and Laird method,^^ and 
fitted for a pooled analysis. For each model, a test for overall 
effect was done. Because of the heterogeneity of our stud- 
ies, the random effects model was more appropriate. Using 
this model, the estimate of the pooled effect measure and its 
CI incorporates the additional variability due to interstudy 
variance (t^). 



Sources of heterogeneity, evaluation, 
and quantification 

Statistical heterogeneity among studies was assessed with 
Cochran's Q test. The magnitude of heterogeneity was evalu- 
ated by the F statistics, which describes the proportion of total 
variation due to heterogeneity rather than chance, /^-values 
of 25%, 50%, and 75% indicate low, moderate, and high 
heterogeneity, respectively." In order to investigate possible 
sources of heterogeneity, two different methods were used: 
subgroup analyses and meta-regression. We stratified our data 
according to the following study characteristics: concealment 
of randomization, blinding of the end point assessors on 
allocated treatment, analyses according to intention-to-treat 
strategy, and presence of a priori power estimation for the 
study. The test for between-group heterogeneity is an issue 
of current debate as it is strictly valid when using the fixed 
effect inverse variance method, and this test is likely to be 
invalid when considerable heterogeneity is observed in one 
or more subgroups. After doing the subgroup analyses, 
we ran a random effects meta-regression analysis, where the 
outcome variable was the observed SMD from every study, 
indicating treatment effect, and study-level and patient-level 
characteristics (covariates). This random effects regression 
model was done to enable exploration of the source of hetero- 
geneity in the association between intervention and outcomes. 
The choice of covariates was based on literature reviews and 
motivated by biological and clinical hypotheses, supported 
by evidence from sources other than the included studies. 
A source of heterogeneity was considered as important if 
the covariate decreased the between-study variance. The 
estimate of r' in the presence of a covariate, in comparison 
to that when the covariate is omitted, allows the proportion 
of the heterogeneity variance explained by the covariate to 
be calculated.^" 

Publication bias or small-study effect 

Publication bias is known to occur in meta-analyses as studies 
with results that are significant, interesting, from large well- 
funded studies, or from studies of higher quality are more 
likely to be submitted and published. A meta-analysis based 
on a literature search will thus include such studies differen- 
tially, and the resulting bias may invalidate the conclusions. 
In order to assess potential publication bias, or "small-study 
effect", we used the funnel plot, which provides a good visual 
evaluation of sampling bias. Funnel plot asymmetry raises the 
possibility of bias but is not a proof of bias. It is important 
to note that asymmetry (unless produced by chance alone) 
will always lead to a questioning of the interpretation of the 
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overall effect when studies are combined in a meta-analysis. 
Sterne et aP^ have suggested that the funnel plot should be 
seen as a generic means of examining small-study effects. 
Small-study effect is the tendency for the smaller studies 
in a meta-analysis to show larger treatment effects. A test 
of asymmetry (Egger's test of the intercept), applied on 
the funnel plot, was performed.^'' According to this, if the 
intercept on the y-axis is null or if its 95% CI crosses the 
zero line, there is no publication bias or small-study effect. 
It is a good practice to avoid evaluating the publication bias 
only according to visual judgment. Nowadays Egger's test 
is mostly seen as a test of small-study effects. 

Detection and correction for publication bias 
using the trim and fill simulation method 

Publication bias is a serious issue as it may lead to biased 
estimates that appear to be precise. A popular method for 
detecting and adjusting bias is the "trim and fill" method." 
This method is suitable also for continuous outcome effects.^* 
Peters et aP' concluded that in the presence of publication 
bias, the trim and fill method can help reduce bias in pooled 
estimates. Even though its performance is not ideal, this 
method is used as a sensitivity analysis for assessing the 
potential impact of missing studies. This method begins 
by estimating the number of asymmetric trials on the right 
side of the funnel plot. These can broadly be thought of 
as trials that have no left-side counterpart. These trials are 
then removed or "trimmed" from the funnel plot, leaving a 
symmetric remainder from which the true center of the fun- 
nel is estimated. The trimmed trials are then replaced and 
their missing counterparts imputed or "filled". This, in turn, 
allows an adjusted overall CI to be calculated. A test of the 
presence of bias could be derived from this method, based 
on the estimated number of missing trials. The estimated 
effect of the missing trials provides an indication of whether 
the imputed missing studies affect the overall result of the 
meta-analysis. 

A simulation study, based on 1 ,000 replications (reflecting 
the results of our meta-analysis for the end point incidence of 
CHF), was done to predict the sample size of a future RCT 
to be performed.'"' *' This analysis is interesting if we want 
to assess the impact of a potential new trial on the overall 
evidence from our meta-analysis. Also, it permits us to assess 
the robustness of the current meta-analysis with respect to 
the inclusion of future data. 

The test of funnel plot asymmetry and meta-regression 
analysis can only be used when at least ten studies are 
included in the meta-analysis, because of power limitations. 



Under the fixed effect model, the power of the meta-analysis 
is driven by the number of subjects accumulated across 
studies and the effect size we want to highlight. Under 
the random effects model, power depends, not only on 
the total number of subjects, but also, on the number of 
studies, the effect size, and the variance between studies 
(heterogeneity). ^''•"'^ 

All statistical analyses were performed with STATA 13.0 
(StataCorp LP, College Station, TX, USA).« We followed the 
Quorum guidelines for meta-analyses and systematic reviews 
of randomized trials in the present report."''' 

Results 

Trial flow 

After identifying 276 references, 252 were excluded due 
to irrelevant content and duplicate publications, leaving 
25 potentially eligible studies. Two were not appropriate for 
inclusion because of unclear randomization procedure, one 
had diverging inclusion criteria, and one was a duplicate 
report of another study. Finally, 2 1 studies were included in 
our systematic review (Figure 1). 

Study characteristics 

The study characteristics are presented in Tables 1 and 2. 
Regarding patient-related variables, the mean age was 59 years 
(standard deviation [SD] =2.2 years), 77% were males, and 
49% were smokers, 44% had hypertension, 48% had dys- 
lipidemia, 20% had diabetes mellitus, and 51% had anterior 
myocardial infarction. On average, time from symptom onset 
to PCI was 246 minutes (SD =63 minutes) and median time 
from PCI to assessment of outcome was 60 days (interquartile 
range 7, 1 80 days). As for the study-level characteristics, ran- 
domization and adequate concealment were present in 67% 
of the trials, blinding of the end point assessor to treatment 
allocation was present in 81%, intention-to-treat strategy was 
followed in 76%, and a priori power estimation was presented 
in 43%. Report of dropouts was present in 43% of the trials. 
The nonbiased and powered studies represented 43%) of the 
included studies. 

Quantitative data synthesis 

Efficacy of IPost on infarct size estimated by CMR 

The results are summarized in Figure 2. Our pooled 
analysis included eight trials showing a pooled effect of 
SMD =-0.062 (95% CI: -0.34 to 0.21, P=0.625) with a mod- 
erate heterogeneity (7^=68%), indicating no effect of IPost 
on infarct size, as estimated by CMR. The majority of these 
trials were of good quality and as the number of trials was 
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Table I Clinical profile of the 21 randomized trials included in 
the meta-analysis 



Study 


Protocol' 


IPost/ 

control, 

N/N 


Symptom End points 
set, hrs 


Staat et al' 


60s X 4 


14/16 


<6 


CK 


Las key" 


90sx2 


10/7 


<I2 


CK 


Ma et al'" 


30s X 3 


47/47 


<I2 


CK, LVEF 


Yang et al' 


30s X 3 


23/18 


>I2 


CK, LVEF, STR 


Thibault et aP 


60s x4 


17/21 


<6 


LVEF, CK, TN 


Laskey et aP 


90sx2 


12/12 


<6 


CK, LVEF 


Lonborg 


30s X 4 


59/59 


<I2 


MISIZE.TN, 


et al« 








LVEF ACE, STR 


Sorensson 


60s x4 


38/38 


<6 


MISIZE, LVEF, 


etal' 








CK 


Xue et al" 


60s x4 


23/20 


<I2 


CK, LVEF, STR 


Lin et al'° 


60s X 3 


58/63 




LVEF 


Garcia et al" 


30s X 4 


22/21 


<I2 


LVEF, ACE, CK 


Liu et aP° 


30s X 3 


30/34 


<I2 


CK-MB, LVEF 


Freixa et al" 


60s x4 


30/31 


<I2 


MISIZE, LVEF 










CK,CK-MB,TN 


Zhao et aP' 


60s x4 


32/30 


<I2 


TN, LVEF 


Tarantini 


60s x4 


39/39 


<6 


MISIZE, LVEF, 


etal'" 








TN 


Thuny et aP^ 


60s x4 


25/25 


<I2 


MISIZE, LVEF, 










CK 


Elzbieciak 


60s x4 


18/21 


<I2 


MISIZE, LVEF, 


et aP' 








ACE 


Dwyer et aP"* 


30s X 4 


50/52 


<6 


MSIZE, LVEF 










CK 


Hahn et aP^ 


60s x4 


350/350 


<I2 


STR, ACE 


Dong et aP' 


30s X 3 


32/30 


<I2 


TN, LVEF, STR 


Limalanathan 


60s x4 


136/136 


<6 


MISIZE, LVEF, 


et aP 








TN, ACE 


Note: ^Protocol 


for duration 


of balloon 


inflation, in 


seconds x number of 



inflations. 

Abbreviations: ACE, adverse clinical events; CK, creatine kinase; CK-MB, creatine 
kinase-MB fraction; IPost, ischemic postconditioning; LVEF, left ventricular ejection 
fraction; MISIZE, anatomic infarct size estimated by cardiac magnetic resonance 
imaging; STR, ST-segment resolution; TN, troponin. 

lower than ten, no meta-regression analysis was performed 
over the patient- and study-level variables. 

Effect of IPost on biomarkers of myocardial necrosis 

The pooled estimate including 18 studies, using the random 
effects model, showed that the release of markers of myo- 
cardial necrosis (creatine kinase [CK], creatine kinase-MB 
fraction [CK-MB], and troponin) after PCI was significantly 
reduced by IPost (SMD =-0.58, 95% CI: -0.96 to -0.19), 
with an P of 90. 1 %, indicating that 90. 1 % of the variation in 
the SMD was attributable to heterogeneity (Figure 3). There 
was no indication of publication bias as the funnel plot was 
satisfactory and Egger's test rejected the null hypothesis of 
small-study effect. 



Analyses specific for each biomarker as outcome showed 
that for the more cardio-specific biomarkers, troponin and 
CK-MB, no effect of IPost was found (SMD =-0.27, 95% 
CI: -0.60 to 0.07, P=0. 120 and SMD =-0.54, 95% CI: -1.66 
to 0.58, /'=0.349, respectively). Regarding the less cardio- 
specific marker, CK, IPost significantly reduced the level 
(SMD =-0.84, 95% CI: -1.37 to -0.31, P=0.003). 

An investigation to identify the main source of heteroge- 
neity was done by subgroup analysis of major parameters of 
critical appraisal (Table 2) - randomization and concealment, 
blinding of end point assessor, intention-to-treat strategy, 
and account for the dropouts that could not be quantified 
correctly, as some studies ignored this. As well, the problem 
of differential drop-out rate was considered carefully for 
every publication. The components of internal validity were 
correlated as the studies of good quality were conducted 
according to evidence-based criteria. We generated a variable 
called "powered and nonbiased studies", which was defined 
as "yes" if the study was satisfactory with regard to the 
aforementioned parameters, otherwise as "no". Our results 
are summarized in Table 3 . The nonbiased and powered stud- 
ies showed no effect of IPost on biomarkers of myocardial 
necrosis, while the trials with deficient methodology showed 
a beneficial effect. 

Effect of IPost on LVEF 

The measurement of LVEF was done either early, before dis- 
charge from the hospital, or during follow up. Unfortunately, 
no study presented change in LVEF. Thus, the pooled 
analysis was done on group differences in LVEF measured 
either in the acute stage or after follow up, rather than on 
between-group changes from baseline. 

In the first meta-analysis, 18 trials were considered. 
A pooled effect showed a moderate improvement of LVEF 
(SMD =0.47, 95% CI: 0.20 to 0.74), with substantial hetero- 
geneity (i^80.8%), using the random effects model. On the 
other hand, the fiirmel plot visually showed the possibility of 
bias or small-study effect. This was confirmed by the Egger's 
test, which had P- value of 0.0 1 , accepting the null hypothesis 
of small-study effect (Figure 4). 

The presence of small-study effect led us to an 
investigation of its origin. It is possible that differences 
between smaller and larger trials are accounted for by trial 
characteristics. The most important characteristic for the 
stratification analyses was the study-level variable "powered 
and non-biased studies". The stratified, pooled meta-analysis 
(Table 4) showed that the "powered and nonbiased studies" 
(eight studies) demonstrated no effect of IPost on LVEF 
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Table 2 Study-level characteristics" of included trials 



Study 



Concealment of 
randomization 



Blinding of assessor to 
outcome treatment group 



Intention to 
treat strategy 



A priori power 
estimation 



Composite 
conditions'* 



Dropouts during 
follow up 



Staat et al' 
Las key 
Maetal'" 
Yang et al' 
Thibault et aP 
Laskey et al'' 
Lonborg et al'" 
Sorensson et al' 
Xue et al" 
Lin et al'" 
Garcia et al" 
Liu et al^" 
Freixa et al" 
Zhao et aP' 
Tarantini et al'° 
Thuny et aP^ 
Elzbieciak et al^-' 
Dwyer et al" 
Hahn et al^= 
Dong et aP' 
Limalanathan et al'' 



Notes: presence of the condition, 0- absence of the condition or unclear; ''composite variable that has the value of I when the following conditions are respected or 
present simultaneously: concealment of randomization, end point assessor blinded to treatment group, intention-to-treat strategy, and a priori power estimation {nonbiased 
and powered studies). 



(SMD =0.17, 95% CI: -0.02 to 0.36, P=0.082), while for 
studies with nonpresence of this condition (ten studies), 
a significant effect of IPost on LVEF was found (SMD =0.71 , 
95% CI: 0.23 to 1.19, P=0.004). 

We extended the analyses with a meta-regression model, 
taking into account patient-related variables (mean age. 



frequency of diabetes mellitus, presence of hypertension and 
dyslipidemia, presence of anterior myocardial infarction, cur- 
rent smoking habits, time from symptom onset to PCI, and 
time of evaluation of LVEF after PCI). Two important patient- 
related variables were identified - presence of hypertension 
and smoking habits. Both of these were associated with 



study 



L0nborg et al^ 
Sorensson et al^ 
Ttiuny et aF 
Tarantini et al'° 
Freixa et al" 
Dwyer et al^" 
Elzbieciak et aP 
Limalanathan et al'^ 
Oyerall (F=68.7%. P=0.002) 




-0.40 (-0.83, 0.03) 
0.37 (-0.11, 0.85) 
-0.72 (-1.30, -0.15) 
0.54 (0.09, 0.99) 
0.26 (-0.18, 0.70) 
-0.27 (-0.71, 0.18) 
-0.05 (-0.68, 0.58) 
-0.25 (-0.50, -0.01) 
-0.06 (-0.34, 0.21) 



Figure 2 Forest plot of anatomic infarct size as estimated by CMR, expressed as SMD. 
Note: Weights are from random effects analysis. 

Abbreviations: CI, confidence interval; CMR, cardiac magnetic resonance imaging; SMD, standardized mean difference. 
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study 
ID 



SMD (95% CI) 



Laskey et al" 

Staat et aP — 

Ma et aP" 

Zhao et aP^ 

Yang et aP 

Laskey et al'^ 

Thibault et al' 

Lonborg et al"^ 

Xue et al" 

Garcia et aP^ 

Liu et aP" 

Freixa et aP^ 

Tarantini et aP" 

Thuny et aP^ 

Dwyer et a\^^ 

Sorensson et aP 

Dong et aP^ 

Limalanathan et aP^ 

Overall (P=90A%, P=0.000) 



4> 



0.08 (-0.88, 1.05) 
-2.44 (-3.41, -1.48) 
-0.65 (-1.06, -0.23) 
-1.56 (-2.19, -0.93) 
-1.01 (-1.67, -0.35) 

-0.75 (-1.58, 0.08) 
-0.96 (-1.64, -0.28) 

-0.14 (-0.50, 0.22) 
-0.77 (-1.39, -0.15) 
-1.28 (-1.94, -0.63) 
-1.33 (-1.87, -0.78) 
2.35 (1.77, 2.92) 

-0.28 (-0.72, 0.17) 
-0.94 (-1.53, -0.35) 

-0.10 (-0.49, 0.29) 
0.13 (-0.32, 0.58) 
-1.13 (-1.67, -0.60) 

-0.09 (-0.34, 0.16) 
-0.58 (-0.96, -0.19) 



% 

Weight 

4.57 
4.58 
5.98 
5.48 
5.41 
4.94 
5.36 
6.08 
5.50 
5.40 
5.59 
5.61 
5.91 
5.59 
6.03 
5.90 
5.71 
6.26 
100.00 



Figure 3 Forest plot for biomarkers of myocardial necrosis, expressed as standardized mean difference SMD. 
Note: Weights are from random effects analysis. 

Abbreviations: CI, confidence interval; SMD, standardized mean difference. 



reduced effect of IPost and explained 17.4% and 27.4% of 
heterogeneity, respectively (Figure 5A and B). However, 
these two covariates were moderately correlated in our 
study (i?=0.64). Finally, a multivariate meta-regression was 
performed, which considered study-level and patient-level 



variables together. The multivariate method identified the 
presence of hypertension and "powered and nonbiased 
studies" as major reasons of heterogeneity, with 28.3% of 
heterogeneity accounted for by these two variables together 
(Table 5). 



Table 3 Subgroup analysis performed with study-level characteristics considered as potential sources of heterogeneity for the outcome 
biomarkers of myocardial necrosis 



Subdivision 


N 


SMD (95% CI) 


SMD=0 
Z 


P-value 




All studies 


18 


-0.58 (-0.96,-0.19) 


2.94 


0.003 


90.1 


Concealment of randomization 












Yes 


1 1 


-0.28 (-0.76, 0.19) 


1.16 


0.246 


91.6 


Inadequate/unclear 


7 


-0.57 (-0.96, -0.19) 


4.53 


0.0001 


70.7 


Outcome assessor blinded to treatment group 










Yes 


14 


-0.48 (-0.92, 0.05) 


2.18 


0.029 


91.2 


Inadequate/unclear 


4 


-0.99 (-1.50,-0.47) 


3.77 


0.0001 


55.2 


Intention-to-treat strategy 












Yes 


13 


-0.46 (-0.92, 0.01) 


1.93 


0.053 


91.8 


No/unclear 


S 


-0.91 (-1.51,-0.32) 


3.01 


0.003 


73.6 


A priori pov/er estimation 












Yes 


8 


0.03 (-0.48, 0.55) 


0.12 


0.902 


91.0 


No/unclear 


10 


-0.58 (-0.96, -0.19) 


6.90 


0.0001 


63.4 


Dropouts during follow up 












Yes 


8 


-0.03 (-0.57, 0.51) 


0.1 1 


0.910 


92.5 


No/unclear 


10 


-1.06 (-1.38, -0.73) 


6.31 


0.0001 


59.5 


Nonbiased and powered studies 












Yes 


8 


0.03 (-0.48, 0.55) 


0.12 


0.902 


91.0 


No/unclear 


10 


-1.08 (-1.39, -0.77) 


6.90 


0.0001 


59.0 



Note: the variation in SMD due to heterogeneity. 

Abbreviations: CI, confidence interval; SMD, standardized mean difference. 
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Figure 4 Funnel plot of the effect of IPost on left ventricular ejection fraction. 
Abbreviations: IPost, ischemic postconditioning; SMD, standardized mean 
difference; SE, standard error. 

To control for selection bias, we considered the trim and 
fill simulation method, to look for missing studies based on 
the fixed effect model, and looked for missing studies only 
to the "left side" of the mean effect. Using these parameters, 
the method suggested five studies as missing. Under the 
random effects model, the point estimate and 95% CI for the 
combined studies, as shown earlier, was SMD =0.47, 95% 
CI: 0.20 to 0.74, P=0.001. Using the trim and fill method, 
the imputed point estimate was altered, SMD =0.17, 95% 
CI: -0.13 to 0.48, P=0.270. This indicates a change in 



magnitude and significance of the pooled effect after cor- 
rection for publication bias or small-study effect. As well, 
Egger's test no longer showed evidence of publication bias. 
These results are in concordance with lack of effect of IPost 
on LVEF, as highlighted in the subgroup of "powered and 
nonbiased studies". 

Effect of IPost on reperfusion, assessed 
by ECG ST-segment resolution 

ST-segment resolution after PCI has been considered a marker 
of myocardial reperfusion (Table 6). We analyzed six trials, 
three of which considered ST-resolution >70% at 30, 90, or 
120 minutes after PCI, while the three remaining trials con- 
sidered ST-resolution >50% at 60 or 120 minutes to indicate 
successful reperfusion. The variation of the pooled estimate 
attributable to heterogeneity was moderate (7=31.3%). The 
pooled estimate effect (rate ratio) was RR =1.08, 95% CI: 
0.95 to 1.21, ^=0.322, indicating no effect of IPost on ST- 
segment resolution. 

Effect of IPost on adverse cardiac events during 
follow up, using the patient-years model 

The results of six trials are summarized in Table 7, using the 
patient-years model to control for variability in the duration 
of follow up. We included the study by Lonborg et al, with the 
longest follow-up time."*^ Analysis showed no effect of IPost 



Table 4 Subgroup analysis performed according to study-level characteristics considered as potential sources of heterogeneity for 
the outcome LVEF 



Subdivision 


N 


SMD (95% CI) 


SMD=0 
Z 


P-value 




All studies 


18 


0.47 (0.20, 0.74) 


3.46 


0.001 


80.8 


Concealment of randomization 












Yes 


13 


0.46 (0.1 1, 0.81) 


2.59 


0.010 


85.1 


Inadequate/unclear 


5 


0.49 (0.19, 0.80) 


3.18 


0.001 


36,1 


Outcome assessor blinded to treatment group 










Yes 


15 


0.44(0.13,0.74) 


2.83 


0.005 


83.0 


Inadequate/unclear 


3 


0.47 (0.20, 0.74) 


4.07 


0.0001 


00.0 


Intention-to-treat strategy 












Yes 


14 


0.46 (0.14, 0.79) 


2.79 


0.005 


84.0 


No/unclear 


4 


0.50 (0.10, 0.90) 


2.47 


0.014 


51.2 


A priori power estimation 












Yes 


7 


0. 1 5 (-0.06, 0.36) 


1.38 


0.168 


37.5 


No/unclear 


1 1 


0.67 (0.24, I.IO) 


3.08 


0.002 


84.8 


Dropouts 












Yes 


8 


0.03 (-0.57, 0.51) 


0.1 1 


0.910 


92.5 


No/unclear 


10 


-1.06 (-1.38, -0.73) 


6.31 


0.0001 


59.5 


Nonbiased and pov/ered studies 












Yes 


8 


0. 1 7 (-0.02, 0.36) 


1.74 


0.082 


32.0 


No 


10 


0.71 (0.23, 1.19) 


2.91 


0.004 


86.1 



Note: H^— the variation in SMD due to heterogeneity. 

Abbreviations: LVEF, left ventricular ejection fraction; SMD, standardized mean difference; CI, confidence interval. 
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Figure 5 M eta- regress ion of left ventricular ejection fraction and (A) proportion of hypertension (%) and (B) proportion of smoking (%). 
Abbreviations: Ht, hypertension; SMD, standardized mean difference; Smk, smoking. 



on mortality (RR=1.49, 95% CI: 0.84-2.64, P=0.167), the 
incidence of reinfarction (RR =1.50, 95% CI: 0.84 to 2.67, 
P=0.\7l) or the incidence of stent thrombosis (RR =1.17, 
95% CI: 0.50-2.74, ^=0.708), or on the frequency of 
the composite end point of major adverse cardiac events 
(RR =1.16, 95% CI: 0.71-1.89, P=0.564). A significant 



beneficial effect of IPost was found on the incidence of new 
onset CHF (RR =0.43, 95% CI: 0.23 to 0.77, P=0M5), 
with no heterogeneity during the follow-up period (7^0%). 
CHF was defined in the majority of studies'^ ''-^'' as a "hard" 
clinical end point - rehospitalization for CHF. Hahn et aP^ 
considered CHF patients in need of intensive care, whereas 
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Table 5 Estimate of the random effects regression model' between the SMD of left ventricular ejection fraction and the different 
study-level and patient-level variables, in a multivariate analysis using the 16 randomized clinical trials 

Covarlates Level P-coefficient Std err (p) Z P-value t^' Heterogeneity'" 

Presence of Yes/no -0.020 1 0.0094 -2. 1 2 0.054 0.329 1 28.3% 

hypertension 

Nonbiased and Yes/no -0.7772 0.3553 -2.19 0.048 

powered studies 

Notes: ^r^- between-study variance, r^-0.4589 model without covariates; ''the heterogeneity accounted by the covariate included in the random effect meta-regression was 
r — r / X 100, where z^„- without the covariates and — including the two covariates. 

Abbreviations: CI, confidence interval; SMD, standardized mean difference: Std err, standard error of the regression coefficient. 



L0nborg et al"^ used a softer CHF definition, ie, patients with 
New YorkHeart Association (NYHA) class 2-4 at 15 months 
follow up. This peculiarity for the outcome CHF led us to 
simulate a new two-arm trial using the results of our meta- 
analysis. This trial had 100 patients in each arm. For this 
calculation, we considered the pooled fixed effect model from 
our meta-analyses (RR =0.43). This gave InRR = ln(0.43) 
equaling -0.8439, and the estimated variance of InRR equal- 
ing 0. 1019 in the equation 

f InRR/RR, Y 

where RR was the effect size and RRj^ was the lower 95% 
CI of the effect size. Another simulation, with 1,000 rep- 
lications, was done and gave us a power estimate of 80% 
with 95% CI: 70.8 to 87.3, indicating that the P-value was 
below 0.01 in 80 of 100 iterations. Finally, we generated 
a power curve for the future meta-analysis. Our results 
are summarized in Figure 6, indicating that a future trial 
with a total sample size of 360 patients with 180 in each 
arm will ensure a meta-analysis with acceptable power 
close to 84%, with 95% CI: 81.6 to 86.3. The resuh of 
our simulation implies that when more data are available, 
a new meta-analysis could provide a conclusive answer 



Table 6 A meta-analysis of six trials for the outcome ST-segment 
resolution as a marker of reperfusion 



Study considered 


Rate 


95% CI 


Time after 


ST 




ratio 




PCI 


resolution 


Yang et al' 


1.12 


0.53-2.35 


1 20 minutes 


>70% 


Lonborg et al"" 


1.29 


0.96-1.75 


90 minutes 


>70% 


Xue et al" 


1.84 


1.09-3.09 


1 20 minutes 


>50% 


Hahn et al" 


0.98 


0.82-1.17 


30 minutes 


>70% 


Dong et aP' 


1.28 


I.0I-I.6I 


1 20 minutes 


>50% 


Limalanathan et al" 


1.02 


0.93-1.10 


60 minutes 


>50% 


Pooled effect estimate" 


1.08 


0.95-1.21 







Note: ^Variation in pooled estimate attributable to heterogeneity is 31.3%. 
Abbreviations: CI, confidence interval; PCI, percutaneous coronary intervention. 



regarding the effect of IPost on the incidence of CHF 
during follow up. 

Discussion 

Our meta-analysis of trials comparing IPost with usual care 
revealed a high degree of heterogeneity among trials for all 
the outcomes, except adverse cardiac events, during follow 
up. Also, publication bias or small-size effect was found 
to influence the outcome LVEF. Meta-regression analy- 
ses indicated that heterogeneity could be explained by 
patient-related variables and study-level characteristics. 
For studies reporting infarct size determined by CMR, 
probably the most robust and biologically relevant of the 
surrogate end points (SEPs) in small- and medium-sized 
STEMI trials,"" there was no effect of IPost on infarct 
size. Also, regarding the SEPs LVEF, ST-segment resolu- 
tion, and the majority of clinical end points, there was no 
effect of IPost, except for a possible beneficial effect on 
the incidence of CHF after the intervention. It has been 
claimed that direct stenting, as opposed to stenting after 
predilation, is important for cardioprotection by IPost."' 
However positive effects of IPost have also been reported 
in studies using conventional stenting. ^''•''^ In the study by 
Frexia et al, analyses showed that direct stenting did not 
influence the impact of IPost on the reported end points." 
Due to few studies, we could not formally test the impor- 
tance of direct stenting in IPost. 

Strengths and limitations 

Our review was based on a broad literature search, and it 
seems unlikely that we missed relevant trials."*^ The trial 
selection, data extraction, and data assessment were done by 
two authors, to minimize bias and transcription errors.^* The 
components used for quality assessment are validated and 
reported to be associated with bias.^' The major limitations 
of our study were the quality of trials, small-study effect, 
heterogeneity, underpowered trials, and the use of SEPs to 
evaluate IPost. 
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Table 7 Meta-analysis of adverse cardiac events of the six individual trials controlling for variability in duration of follow up, using the 
patient-years model 



Study considered 



I Post 



Patient-years 



Control 



Patients years 



RR 



9S%CI 



End point: mortality 

Lonborg et al'*'" 

Garcia et al" 

Hahn et aP= 

Limalanathan et aP 

Pooled-effect estimate 
End point: reinfarction 

Lonborg et al""' 

Hahn et aP= 

Limalanathan et aP 

Pooled-effect estimate 
End point: stent occlusion 

Lonborg et al''^" 

Hahn et aP' 

Limalanathan et aP 

Pooled-effect estimate 
End point: CHF 

Lonborg et al'"' 

Garcia et al" 

Hahn et aP= 

Dong et aP' 

Limalanathan et aP 

Pooled-effect estimate 
End point: major adverse events 

Elzbieciak et aP^ 

Hahn et aP' 

Pooled-effect estimate 



3 
I 

13 
4 



4 

13 
4 



7 
2 
2 

0" 
2 



4 

15 



70 
74.8 

29.15 
39.9 



70 

29.15 
39.9 



70 

29.15 
39.9 



70 

74.8 

29.15 

2.66 

39.9 



18 

29.15 



I 

0" 
10 
2 



I 

10 
2 



15 

4 

5 

2 

5 



4 
13 



68.75 
71.4 
29.15 
42.99 



68.75 
29.15 
42.99 



68.5 

29.15 

42.99 



68.75 

71.4 

29.15 

2.50 

42.99 



21 

29.15 



2.95 
2.86 
1.30 
2.15 
1.49 

3.93 
1.30 
2.15 
1.50 

0.20 
1.17 
3.23 
1.17 

0.46 
0.48 
0.40 
0.19 
0.43 
0.43 

1.17 
1.15 
1.16 



0.31-27.64 
0.12-69.15 
0.68-2.48 
0.42-1 1.13 
0.84-2.64 

0.45-34.27 
0.68-2.48 
0.42-1 1.13 
0.84-2.67 

0.01^.00 
0.45-3.05 
0.35-29.81 
0.50-2.74 

0.20-1.05 
0.09-2.53 
0.08-1.90 
0.01-2.28 
0.09-2.09 
0.23-0.77 

0.34-4.01 
0.67-1.97 
0.71-1.89 



Notes: ^We considered the study by Lonborg et al""^ with the longest duration of follow up; ''the problem with zero cell, was dealt with by adding 0.5 to the two arms. 
Abbreviations: CHF, congestive heart failure; CI, confidence interval; IPost, ischemic postconditioning; RR, relative risk. 



Quality of trials and the effect 

of IPost on biomarkers of myocardial 

necrosis and LVEF 

Our results concerning the efficacy of IPost compared 
with usual care on the outcome biomarkers of myocar- 
dial necrosis and LVEF were altered when stratifying on 

Power curves for outcome incidence of CHF 
with 95% confidence intervals 
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Figure 6 Simulation of power study for a future meta-analysis that could include a 
future trial with end point, incidence of CHF, using the fixed effect model. 
Abbreviations: CHF, congestive heart failure; CI, confidence interval. 



the components of trial quality. As recommended by the 
Cochrane Collaboration tools for assessing risk of bias 
in randomized trials,^' we did not use summary scores to 
identify quality of trials. Instead, we assessed trials meth- 
odologically and individually and explored the influence 
of each on the effect size. Many meta-analyses assess the 
quality of trials and exclude trials of low quality in sensi- 
tivity analysis. When we stratified on the quality of trials, 
we conclusively found no effect of IPost on markers of 
myocardial necrosis and LVEF. 

IPost and small-study effect 
for the outcome LVEF 

In the included studies, LVEF was measured by echocar- 
diography or CMR at different time points after PCI, within 
7 days or up to 4 months. The differing durations of follow 
up were investigated by meta-regression and did not alter 
our conclusion. The change in LVEF before and after IPost 
would be most interesting for an evaluation of the efficacy 
of the procedure as opposed to a single estimate of LVEF 
taken after PCI. However, estimates of LVEF before PCI 
would be difficult to obtain in a STEMI trial. 
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The majority of the trials in our study were small, except 
for Hahn et aP^ and Limalanathan et al.'^ Because of this, 
there was a tendency for the small trials to show larger treat- 
ment effect. The plausible reason for the effect of intervention 
to be greater in smaller trials is that differences between small 
trials and larger trials are accounted for by trial characteris- 
tics, as pointed out in our study. An investigation by Hempel 
et al used Monte Carlo simulation and concluded that larger 
treatment effects were highlighted in lower quality trials as 
compared with trials of higher quality. In our study, the 
nonbiased trials gave a clear answer for the nonefficacy of 
IPost as compared with usual care for the end point biomark- 
ers of myocardial necrosis and LVEF. 

Unfortunately, in the trials included in our meta-analysis, 
13 out of 21 did not have an a priori power evaluation 
for the primary outcome considered. Some investigators 
have studied the impact of underpowered trials on meta- 
analysis results.^' In previous meta-analyses of controlled 
pharmacological trials, effects were 15% better in under- 
powered than in adequately powered studies and 12% 
better in meta-analyses of controlled nonpharmacological 
trials. In an empirical approach, the standard error of the 
intervention effect increased by a median of 1 1 % when the 
underpowered studies were omitted, and between-study het- 
erogeneity tended to decrease. The investigators advocated 
the omission of underpowered trials in a meta-analysis.^' 
When we used this strategy in our meta-analysis, the lack 
of effect of IPost in the treatment of STEMI was clearly 
demonstrated. 

The problem of heterogeneity 
due to patient-level and study-level 
variables in our study 

Meta-regression analyses on patient-level and study-level 
variables were performed when heterogeneity was pres- 
ent but was not performed when the number of studies 
was less than ten. Patient-level variables were specified 
a priori in the protocol of our study, taking into consid- 
eration only biologically plausible mechanisms, in order 
to safeguard against biased conclusions.^'' Patient-related 
variables were limited, to avoid potentially false-positive 
results. Because of power problem and concern, most 
experts recommend that not more than one covariate for 
every ten studies be evaluated in a single model/analysis 
in the meta-regression.^^ This means that at least 20 studies 
would be required to run a multivariate meta-regression 
(two variables addressed at the same time in the meta- 
regression). Our multivariate model was performed on 



only 15 studies and suffers from power limitation. How- 
ever, a multivariate analysis has an advantage as it may 
better control for confounding. On the other hand, it is 
well known that aggregate variables (patient-related vari- 
ables) are subject to ecological fallacy and must only be 
considered as hypothesis generating,^'' while study-level 
variables considered in a meta-regression can detect true 
associations between heterogeneous treatment effects and 
the study-level variables." 

Discrepancies in efficacy of IPost 
between surrogate endpoints 
and clinical outcomes 

Our results suggest that IPost has no efficacy compared 
with usual care with respect to the SEPs infarct size esti- 
mated by CMR, biomarkers of myocardial necrosis, LVEF, 
or ST-segment resolution or on the incidence of adverse 
cardiac clinical events, with the exception of a reduction 
in the incidence of CHF during follow up. The number 
of patients with CHF during follow up was small, and 
this result must be interpreted with caution. Functional 
status is often evaluated according to the New York Heart 
Association classification system. This classification is 
limited to only four levels and can easily miss clinically 
important variations if the changes are relatively small in 
magnitude, and interobserver agreement is often poor.^^ 
The consequences of assessing CHF by New York Heart 
Association class is that there is a probability of misclas- 
sification of this end point. In the study by Lonborg et al,*^ 
the investigator was blinded to the treatment groups when 
assessing the functional status of the patient. The nature 
of this misclassification is nondifferential,^' and its effect 
will dilute the efficacy of IPost on the incidence of CHF. 
Presumably the true effect of IPost is stronger than the one 
estimated by this study. 

All studies included in our analyses had SEPs as primary 
outcomes. Infarct size measured by CMR has been shown to 
be associated with clinical outcome and is probably the most 
robust SEP to evaluate the effect of new treatment strategies 
in moderate-size STEMI trials.'*' '''' Some investigators have 
reported the effect of IPost on myocardial salvage, ie, infarct 
size as a proportion of area at risk, but there were too few 
such studies to perform a meaningful meta-analysis using 
this outcome. However, ultimately, a large-scale, randomized 
trial with clinical end points is needed to determine the effect 
of a new treatment principle. In the case of IPost, to the best 
of our knowledge, only one such study is ongoing, aiming 
to include 2,000 STEMI patients and including a clinical 



submit your manuscript | www.dovepress.com 
Dovepress 



Vascular Health and Risk Management 2014:10 



DovcTiress 



Postconditioning in ST-elevation myocardial infarction 



composite primary end point consisting of cardiac death, 
reinfarction, and heart failure.''' AUhough our data strongly 
point to a neutral effect of IPost in STEMI, it is conceivable 
that IPost might affect adverse clinical events by unknown 
mechanisms operating independently of the mechanisms that 
determine SEPs.'^"'^'' 

Implications for research 

The quality of reporting in the included trials of our meta- 
analysis was variable. Future trials should adhere to the 
methodological standards that reduce possible bias, including 
concealment of allocation, blinding of treatment groups for 
outcome assessors, measures to reduce the drop-out rate, and 
an analysis based on all patients recruited, regardless of the 
intervention (intention-to-treat strategy). Also, an a priori 
power analysis is mandatory. Moreover, reports of trials 
should adhere to generally accepted standards of reporting 
clinical trials (Consolidated Standards Of Reporting Trials 
[CONSORT] statements),*^ and we advocate for continua- 
tion of the clinical follow up, in order to find a final answer 
on the efficacy of IPost on the long-term incidence of CHF 
during follow up. 

Implications for practice 

Trials using SEPs can be misleading and may confuse clinical 
decisions. RCTs large enough to evaluate effects on clini- 
cal outcomes are essential for evidence-based decisions in 
clinical practice. Our results suggest that further careful trials 
with appropriate size and clinical end points are necessary 
before proposing IPost as a supplement to primary PCI in 
the treatment of STEMI-patients. 
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